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Abstract 

This paper deals with temporal enzyme distribution in the activation of biochemical path- 
ways. Pathway activation arises when production of a certain biomoleculc is required due 
to changing environmental conditions. Under the premise that biological systems have been 
optimized through evolutionary processes, a biologically meaningful optimal control problem 
is posed. In this setup, the enzyme concentrations are assumed to be time dependent and 
constrained by a limited overall enzyme production capacity, while the optimization crite- 
rion accounts for both time and resource usage. Using geometric arguments we establish the 
bang-bang nature of the solution and reveal that each reaction must be sequentially activated 
in the same order as they appear in the pathway. The results hold for a broad range of 
enzyme dynamics which includes, but is not limited to. Mass Action, Michaelis-Menten and 
Hill Equation kinetics. 

1 Introduction 

Metabolic networks consist of pathways of biochemical reactions which consume and produce 
required biomolecules. Pathway performance depends on network structure and the kinetics of 
the enzymes which catalyze each interaction [T], leading to diverse dynamic behaviors in terms 
of stability, steady state and transient response. Most cellular processes rely on the appropriate 
operation of some set of pathways and so their behaviour underpins functional requirements for 
cellular operation. It has been proposed that metabolic dynamics play a significant role in cell 
fitness, and so metabolic system design has been optimized through evolutionary processes [2]. 

In this paper we address the mechanism responsible for the distribution of enzyme concen- 
trations in a metabolic pathway in such a way that a meaningful optimality criterion is satisfied. 
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Previous studies have tackled this problem by considering a number of objective functions, e.g., 
flux optimization [21 [3l S] , minimization of total enzyme concentration [5] and maximization of 
growth rate [6]. All these works focus on the steady state properties of the pathway and limit the 
analysis by considering constant enzyme concentrations [21 [3l HI O [6] . Nonetheless, the temporal 
distribution of the enzyme concentrations may have a critical impact on the pathway behavior. 
Well defined hierarchical temporal patterns have been observed in enzyme expression levels in 
amino acid [7| and E. coli flagella biosynthesis [8]. In addition, certain metabolic pathways are 
naturally at rest and become active under changes in external conditions or when certain key 
biomolecules are required. In cases where the cellular response impacts fitness, we may presume 
that the activation of these pathways will occur as quickly as possible. Since the cell has a 
limited biosynthetic capacity there must be a mechanism that accounts for appropriate enzyme 
allocation over the activation period. 

Time dependent optimal enzyme profiles have been considered in recent papers [9l [71 [10] 
considering the case of unbranched pathways. Though using different approaches, all these works 
conclude that sequential behaviors, such as the one experimentally shown in [7], can be ra- 
tionalized by optimality principles. The main drawback behind these results lies in their lack 
of generality, either because only a particular case is solved [7], or because simple (and often 
unrealistic) enzyme kinetics are assumed [HI [10] . 

As in [To], the motivation for this work is the observation that the problem dealt with in [9] 
can be naturally posed in terms of classical optimal control [11]. Here we formulate a similar 
problem in a standard control theoretic framework and, using a cost functional that accounts for 
both time and enzyme usage, we extend the results of [10] in three directions: (a) the developed 
framework allows mass exchange between the pathway and its environment; (b) the results show 
that the reactions must be fully activated one at a time, following the same sequence as they 
appear in the pathway; (c) the derived qualitative behavior is valid for a broad class of enzyme 
kinetics that includes, but is not restricted to, the common Mass Action, Michaelis-Menten and 
Hill Equation kinetics |12j . 

The main theoretical tool used throughout this paper is Pontryagin's Minimum Principle 
(PMP) [11]. Together with simple geometric arguments, the PMP provides qualitative infor- 
mation regarding the bang-bang form of the optimal solution and the sequence in which the 
activations must be performed. We emphasize that in this paper we do not attempt to obtain 
a complete solution of the optimization problem, but rather we aim at deriving qualitative in- 
sights into the solution that extend and are consistent with the previous attempts to explain the 
sequential behavior seen in [7]. Similarly, it must be stressed that the approach taken in this 
paper should not be confused with a time-optimal control design problem, since our idea is to 
rigourously explain a behavior that is already present in some biological systems. Besides the 
derivation of the main results, this paper intends to set a bridge between well known results per- 
taining to control theory and the systems theoretical analysis of biological systems, an approach 
that is recently emerging as a cornerstone in the systems biology field. 
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2 Preliminaries 



In this section, we briefly state the main results of optimal control theory developed by 
Pontryagin and co-workers [11] . We are interested in dynamical systems of the form 

xit) = f{x{t),u{t)), (1) 
x{0) € M", (2) 

where x{t) G M" is the state vector, u{t) € W is the control input vector, and / {x{t),u{t)) is a 
continuously differentiable function. Suppose that the control objective is to drive the state x(t) 
from x{0) to a final condition x{tf) G S, where S C M". We denote the set of admissible values 
for u{t) as U, and let Mk be the set of piece- wise continuous functions u : [0, i/) — > U. The 
objective is then to determine an optimal control input, u*{-), such that 

= arg min J', (3) 

where the target cost functional is 

J = q{x{tf))+ r g{x{t),u{t))dt. (4) 
^0 

Define the Hamiltonian as 

n {x{t),u{t),p{t)) = g {x{t),u{t)) + p{tff {x{t),u{t)) , (5) 

where the vector p{t) € M"' is the system's co-state. The PMP gives the following set of necessary 
conditions for optimality: if an optimal u*{-) exists, then there exist nontrivial trajectories x*{-) 
and p*{-) such that: 

(a) The set of differential equations 

. dU{x*{t),u*{t),p*{t)) 

^ ^ dn{x*{t),u*{t),p*{t)) ^ 

dx ' 

is satisfied subject to the boundary conditions x*(0) = x(0) and x*{tf) € S. 

(b) The Hamiltonian is minimized by the optimal control input u*{t) for all t € [0, t/], i.e., 

nix*{t),u*{t),p*{t)) = mm n{x*{t),uit),p*{t)). (8) 

u{t]eu 

(c) The Hamiltonian for the optimal control input is zero for all t € [0,^/], that is, 

n{x*{t),u*{t),p*{t)) = o,yt e [0, tf] (9) 

(d) The costate satisfies the terminal condition p*{tf) G 5^, where is orthogonal to S at 
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3 Problem formulation 



3.1 General setup 

We deal with unbranched metabolic pathways as depicted in Fig. [H where xq denotes the 
concentration of substrate feeding the pathway, Xi is the concentration of the ith. intermediate 
metabolite and Vi is the chemical rate characterizing the ith reaction. In general, we assume that 
Vi{t) = Vi {xi{t),Ui{t)), where Ui{t) is the concentration of the enzyme catalyzing the ith reaction. 

1^0 Vl Vn-l Vn 
Xq ^ X\ ^ ' ' ' ^ Xyi ^ 

Figure 1: Unbranched metabolic pathway. 

Following established techniques for analyzing metabolic pathways, the substrate xq is as- 
sumed to change in a time scale that is considerably slower than the pathway in which we are 
interested and therefore it is considered as a constant in our analysis. 

Each rate law Vi characterizes the kinetic properties of one of the enzymes catalyzing the 
reactions in the pathway. These are typically nonlinear in the metabolite concentration Xj, so 
a general analysis is often not tractable. However the results presented in this paper hold for a 
fairly broad class of enzyme kinetics, namely those satisfying the following assumptions. 

Assumption 1 

lA Each rate law is linear in the enzyme concentration, i.e., they can he written as 

Vi{xi{t),Ui{t)) = Wi{xi{t))ui{t), Vi = 0, 1, . . . ,n, (10) 
where Wi{xi{t)) does not depend on Ui{t). 
IB It holds 

u;i(0) = 0, Vi = 0,1,... ,n, (11) 

^ > 0, Vxi G (0,cx)) , Vi = 0, 1,... ,n, (12) 
dxi 

Assumption [T]A is satisfied by most enzyme kinetic models |12] . while (llip in Assumption [TjB is 
trivially satisfied since a nonzero concentration Xi{t) is required for reaction i to occur. Equation 
(|12p states no more that, for a constant enzyme concentration, an increase in substrate Xi yields 
an increase in the rate, possibly reaching a saturation state when Xi grows unbounded. Therefore, 
Assumption [1] is satisfied by a broad class of enzyme dynamics which includes, in particular. Mass 
Action, Michaelis-Menten, and Hill Equation kinetics. Unless otherwise stated, for the sake of 
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notational simplicity in what follows we will only write time t as independent variable, so that 
expressions like Vi{xi(t),Ui(t)) will be denoted just as Vi(t). 

The ODE model for the pathway in Fig. [T]is given by conservation of mass as 

Xi{t) = Vi.i{t) - Vi{t), \fi = l,2,...,n, (13) 

To account for the positivity of the enzyme concentrations and the limited total enzyme 
availability, we will impose the constraint u{t) G U, where U is a simplex in M"'''^ given by 

\ > 0, Vi = 0,1,... ,n. ^ ^ 

For future reference we define the state, control, and flux vectors as 

x{t)=[xi{t) X2{t) ••• (15) 
u{t)=[uo{t) Ui{t) ■■■ Un{t)f , (16) 
vit)=[voit) Vlit) ■■■ Vnit)f . (17) 



3.2 Optimal control problem 

Assuming that the pathway is initially at rest, i.e. ^^(O) = 0, Vi = 1,2, ...,n, we aim at 
obtaining enzyme temporal profiles that in the time interval [0, tf) drive the pathway to a 
steady state characterized by a prescribed constant flux V S M+. From Fig. [1] and (jl3p this 
implies 

Vi{t) = V,yt>tf,yi = 0,l,...,n. (18) 

As is clear from (fT2]) . each Vi can (and usually does) saturate to some upper bound, so in the 
sequel we will assume that the target final flux V is consistent with those upper bounds. The 
enzymes comprised in u{t) should minimize a measure of the time and resource usage during the 
pathway activation. To that end we define the cost functional 

J = r [l + a^u{t)) dt, (19) 
Jo 

where the weight a G M"^^ is entry wise nonnegative. The positivity of u{t) implies that 
the minimization of J7 implies a combined optimization of: (i) the time taken to reach the new 
steady state and, (ii) a measure of the energy demanded by the enzyme usage. Regardless the 
result given by the optimization for t € [0, tf), we must guarantee that the steady state flux V 
is achieved for t > tj, which from ([TO]) and (fT8|) implies that 

u^it) = —^,yt>tf,yi = 0,l,...,n. (20) 

Wi[tj: ) 
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Note that (j20p specifies the constant enzyme levels needed after t = tf in order to reach the 
target steady state flux V. It should be stressed that the optimization is performed over the 
open interval [0, tf) so that the enzyme levels in (j20p are not significant to the optimization. 
This also implies that the terminal state for the optimization problem is defined by x{tj) = 
lim^^o ^{tf — S), S > 0. The continuity of x{t) implies that the value of x{tj) must be consistent 
with the prescribed steady state flux V and the input constraints defined in ()14p . which by using 
(j2Up implies that the final state must belong to the set 

n 

^ Wi{Xi{tf)) 

In summary, the optimal control problem can be stated as follows. 

Problem 1 Given the system (|13p with the initial and terminal conditions 

x{0) = 0, (22) 
lini x{tf - 5) eS, 6>0, (23) 

where S is the set (|2ip and V G M_|_ is a feasible flux, find 

«(•)* = arg min J, (24) 

where U and J are defined in ([H]) and p9p respectively. 



4 Properties of the optimal solution 

Solving the boundary value problem (BVP) in ([6]) and ([7|) can be a difficult task. In this 
section we derive some properties of the optimal solution without solving the BVP, but rather 
by using geometric arguments together with ([8]) and ([9]) . The key elements in our derivations are 
the linearity of the Hamiltonian in the control variables and the geometry of the feasible region 
U. 

Referring to ([5]), ()10p . and (jlSp . the Hamiltonian is given by 

n{x{t),u{t),p{t)) = 

n 

1 + a^u{t) + ^Pi(t) {wi^i{t)ui^i{t) - WiUiit)) , (25) 

i=l 

n 

= 1 + Y^hi{t)ui{t), (26) 

i=0 
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where the function hi{t) is called the ith switching function and, in general, depends on the 
concentration vector x{t), the substrate xq and the co-state vector p{t). The main result of this 
paper is presented next. 

Theorem 1 The solution to Problem [I] is unique and given by 



where {Tq, Ti, . . . , T„_i} is a partition of the interval [0, tj) such that To = [0, to) o,nd Ti = 
[tj_i, tj ) , Vz = 1, 2, . . . , n, with ti < tj, ^ i < j and tn-i = tj. 

The proof appears in the Appendix. 

The result of Theorem [T] reflects that considerable information regarding the solution to 
Problem [1] can be obtained without the need of solving the BVP arising from applying the PMP. 
The metabolic pathways under consideration can exhibit nonlinear dynamics, leading to a quite 
involved form of the BVP and hence considerably complicating its solution. Thus, the information 
provided by Theorem [1] is a convenient way to overcome the difficulties introduced by the BVP 
and still be able to identify its qualitive behavior. 

Moreover, this characterization of the solution makes the computation of the optimal input 
much easier, since one needs only to optimize over the n switching times {to, ti, • • • , tn-i}, rather 
than over the whole class of admissible inputs. 

Equation (I27p states that the optimal enzyme profiles are of bang-bang type and are com- 
posed of switching sequences between and the maximum level Et- This clearly resembles the 
nature of solutions in classical time-optimal control [TT] and has interesting implications in the 
context of metabolic pathway activation. In fact, from (j27p we first note that optimizing the 
pathway activation implies that for any time instant, all the available enzyme must be used, thus 
demanding full enzyme biosynthetic activity. Moreover, the optimization enforces activation of 
only one reaction at a time and most importantly, the sequence of activations follows a well 
defined temporal pattern. The optimal activation sequence is {vq, vi, . . . , Vn-i}, a pattern that 
exactly matches the ordering in which the reactions appear in the pathway. This phenomenon 
has been described in [9l [7] for the special case of specific pathway lengths and reaction kinetics 
(Mass Action in the first case and Michelis-Menten with transcriptional regulation in the latter). 
Since the requirements imposed by Assumption [T] hold for a broad class of enzyme kinetics. The- 
orem [1] extends the finding of sequential behavior to a more general class of metabolic pathways 
than previously considered. In addition, we note that reaction w„ does not appear in the optimal 
sequence, since its activation is not required to drive the pathway to the final state, but only to 
achieve the target chemical flux V after the time interval where the optimization is performed. 
The sketch in Fig. [J] indicates shows a qualitative plot of the optimal solutions (with n = 3, 
Et = 1 and t/ = 8.5). It should be noticed that for t > tf the optimal enzyme profiles are 
obtained directly from ()20p . 




Vt G Ti 

yt^T, 



(27) 
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The generality of the results suggests that the aforementioned sequential behavior is a fea- 
ture underlying time-optimal activation of unbranched pathways rather than a property arising 
from studying specific case. The activation sequence depends essentially on the time courses 
of the switching functions and, as can be checked from (|3ip in Appendix [Aj the ith reaction 
is activated whenever the corresponding switching function hi{t) is the minimum of the set 
{/io(t), hi{t), . . . , hn{t)}. Further consideration reveals that the sequential behavior is a conse- 
quence of both pathway structure and a common property shared by the enzyme kinetics. From 
an intuitive point of view, the "pipeline" structure of the pathway implies the zth metabolite can- 
not be produced unless the upstream portion of the pathway has already been built up. Moreover, 
the monotonicity of the chemical rates, as expressed by (jl2p in Assumption [TJB, precludes the 
possibility of having to activate an upstream reaction after the ith has already been activated, a 
fact that arises from ([Hj) and ([15|) . This analysis suggests that the described sequential behavior 
might be indeed a property underpinning time-optimal unbranched pathway activation. 

The form of the optimal enzyme profiles reveals an inherent regulatory mechanism that allo- 
cates enzyme concentrations to achieve optimality. In cellular systems this regulation is performed 
at a transcriptional level through the regulation of the transcription factors that trigger the ex- 
pression of the required enzymes. However, so far we have excluded from our analysis any sort 
of metabolite-level regulatory mechanisms, which in some cases are crucial to perform biological 
functions. This issue is briefly dealt with in the next section for a particular case. 




5 t| 10 5 t| 10 




1 2 3 4 5 6 7 8 1, 9 10 11 

Time 



Figure 2: Qualitative sketch of optimal solution for n = 3, Et = 1 and tf = 8.5. 

5 About feedback regulated pathways 

On the metabolic scale, regulation is often implemented through allosteric enzymes, which 
display a distinctive kinetic behavior [12]. The key idea is that the catalytic activity of an 
allosteric enzyme is dependent not only on its substrate, but also on another metabolite in the 
pathway. To illustrate this situation, let us consider an unbranched pathway as the one depicted 
in Fig. [5l which has an inhibitory feedback loop from X3 to reaction vq. 
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Figure 3: Pathway with an ahosteric feedback loop. 



In this case we extend the definition of the reaction rate vq so that that vo{t) = vq {xQ{t),xs{t),UQ 
A widely accepted model for allosteric kinetics [H] is given by 



where the parameters {k, n, L, Kg, Kj) are characteristic for each allosteric enzyme. 

It can be seen that, though vq is nonlinear in both xq and X3, it is still linear in uq. A 
close look at the proof presented in Appendix |A] reveals that in this case the analysis remains 
unchanged and therefore, the results presented in the previous sections still hold in this more 
complex scenario. From a control theoretic viewpoint, this is an interesting result since it states 
that, in this particular case, the form of the optimal solution is invariant under allosteric feedback 
of this kind. 

On the other hand, since the feedback modifies the steady state concentrations, from a bi- 
ological viewpoint this finding suggests that this sort of feedback inhibition may have a much 
more significant role in regulating steady state behavior than in regulating the dynamic behavior 
of pathway activation. This implication has not been corroborated experimentally. 

6 Concluding remarks 

Using geometric properties of the cost functional and the feasible set of control inputs, we 
have derived qualitative properties behind the optimal activation of metabolic pathways. The 
main strength of the results lies on the fact that mild assumptions on the reaction kinetics are 
required, thus encompassing a broad family of monomolecular kinetics. Interesting extensions 
would be to include enzyme production dynamics, transcriptional regulation and the study of 
multimolecular reactions. 
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A Proof of Theorem [T] 

Denote the set of vertexes oi U as V = {eo, ei, . . . , e^} U {0}, where has Et in its 
(i + l)th entry and elsewhere. Similarly, the set of n— dimension faces of U is defined as 

= {Fq, Fi, . . . , Fn} U {V}, where Fi and V are the faces defined by the hyperplanes Fi = 
{u{t) e U : Ui{t) = 0} and V = {uit) G U : Er=o^i(*) = ^t}, respectively. We notice from ^ 
that TC {x{t),u{t),p(t)) is a linear function defined over the convex polyhedron U. Therefore, 
from ([5]) it follows that the optimal control is located in the boundary ofU for all t £ [0, tf) and, 
moreover, it holds that u*{t) G V, Vt G [0, tf). Let u*^{t) be the optimal solution for t € [ta, th] 
such that u*^{t) is located at vertex Cj. If there exists another optimal solution u*'^{t) ^ u*^{t) 
for t € [ta, tb] such that u*'^{t) £ Fi\V, then the linearity of Ti. implies that any point in Fi is also 
optimal for t € [tai^b]- In particular, since E Fi,\/i, this implies that the origin is also optimal. 
However, from ([9]) it holds that 7i must vanish along the optimal trajectory, which together with 
(f26l) makes clear that u*{t) / 0, Vt G [0, tf), thus contradicting the optimality of the origin. 
Hence it follows that u*{t) ^ Fi\V, Vz, so that u*{t) S V and therefore the optimal solution 
satisfies 

n 

Y.ul{t) = ET. (29) 

1=0 

Let {To, Ti, . . . , Tq} be a partition of the interval [0, tf) such that Tq = [0, to) and Tj = 
[ti-i, ti) , y i = 1, 2, . . . , q, with ti < tj, Vi < j and tg = tf. Let = {ui} , i £ I^, be the set 
of enzymes in the optimal solution that are active in the interval Ti, that is, the optimal control 
u*{t) lies in the convex hull of vertexes {ej} , j £ Ii, Vt £ T^. This implies that each control 
satisfies Ui{t) > 0, V t £ Ti, y i £ Ii and they belong to the surface 

^u,it) = ET. (30) 

i&e 

We consider the partition {To, Ti, . . . , Tg} in such a way that C/* / U*^-^, Vi = 0, 1, . . . , q—l. 
By using ([9]) and (f26l) it follows that for all t £ [0, t/) there exists hi{t) < for some i £ 
{0, 1, . . . , n}, which together with ([8|) implies that 

hj{t) = min{/io(t), hi{t), Kit)} , Vj G I^, Vt £ Te. (31) 

In addition, from combining ([9]), (j26p . (j30p . and (I3ip it follows that the switching function 
corresponding to each active enzyme is given by 

/i.(t) = - J- < 0, yi£li,yt£Te. (32) 
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In this setup, the proof follows by showing that 

C/; = {na,V^ = 0, 1, (33) 
q = n-l. (34) 

From (j25p and (j26p it can be shown that the ith switching function is given by 

hi{t) = ai + {Pi+i{t) -pi{t))wi{t), Vi = 0, 1, . . . , n, (35) 

with po{t) = and p„+i(i) = 0. Similarly, from ([7|), (fT3]) . and ([26]) we derive the general form of 
the ODE for the ith co-state 

Pi{t) = {Pi{t) - Pi+i{t))-^Ui{t), Vi = 1, 2, . . . , n. (36) 

We note from (llip and (I2ip that x{tj) ^ 0, which using the fact that x(0) = implies that 
each Ui{t) must be active for some nonempty interval, i.e. for each Ui, i = 0, 1, . . . , n there exists 
an interval Ri ^% such that 

ui{t) ^o,yteRi. (37) 

The proof follows using an inductive procedure based on the following result. 

Fact 1 Consider interval Ti, £ > 2, and assume that 

Xi{ti) = 0, \f i > £ + 1, (38) 
U* = {uj} , Vj < 1 (39) 

Then, 

= {n,+i}. (40) 

Proof: 

From (fT3l). (1351). and (1361) it can be shown that 



hj{t) = {Pj + l{t) -p,{t))Wj{t) + 

duo ' 

{Pj+i{t) - pj{t)) g^ijit), Vj <£,yte Te, 

= (Pj+lit) - Pj+2it)) -—^Wj{t)uj+l{t)- 
{Pj{t) -Pj+i{t)) -^Wj^i{t)x 

Uj-i{t),yj <n,yt£Te,. (41) 
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Equation (|1T|) shows that the only inputs that affect hj{t), M t ^ Tn are Uj-i(t) and 
Therefore, since Uj{t) = 0, Vj 7^ ^, Vt € Ti it follows that 

hj{t) = 0, V j < £ - 1, V j = ^, Vt G ^^ (42) 

On the other hand, if j = i — 1 then Uj^i{t) = Et, \lt ^ and Uj-i{t) = 0, which after 
substituting in ([¥T]) yields 

= {Pi{t) - Pniit)) -^^Wi_i{t)ET, yt e ^^ (43) 



Combining (j43p and (j35p with i = ^ leads to 

/..-rW = ( ^n^.-^mr, Vt E T,. (44) 
V Wi{t) J dxi ^ 

Equation (j35p with i = ^ implies that it'^(t) > 0, Vt G Ti, since otherwise /i£(t) = ai >0 for some 
t Ti and (j32p cannot be satisfied. This guarantees that /i£_i(t) in (j44p is well defined in the 
interval T^. Similarly, ([35|) and ([39]) imply that t(;£„i(t) > 0, Vt € Tg^i and X£_i(t) = 0, Vt S T^, 
which means that wi-i{t) is constant in Ti so that u;^_i(t) > 0, Vt € T^. Using (|12p . (|32p and 
a£ > in ([111) yields 

/i^„i(t) > 0, Vt G T^. (45) 

Therefore, combining (I39p with ()32p . ()42p . and ()45p implies that the trajectory of the jth 
switching function satisfies 

hj{t) = -^,yj <e,yteTj, (46) 

hj{t)>o,yj <£,ytGTj+u (47) 
hj{t) = o,yj < e,ytj+i <t <te. (48) 

Suppose that Uj € f^^+i, i < ^> then in order to satisfy ([32|) . ([l6]) - ([l8]) imply that /ij(t) must 
be discontinuous at t = ti, which is not possible since both x{t) and p{t) are continuous. Hence, 
it follows that 

uj^u!+^,yj <e. (49) 

For the case when j = £, suppose that U£ E holds, then in particular vertex is 

optimal Vt G T^+i, which implies that U^_^-^ = Ug, contradicting the fact that U* ^ U*_^_i, Vi = 
0, 1 . . . , g — 1, and therefore we have that 

Ui i U;+,. (50) 
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Now suppose there exists Uj € U^_^-^, j > then the Hnearity of 7i {x{t),p{t),u{t)) and U 

implies that in particular vertex ej is optimal Vt G T^+i, which implies that 

ii(t) = 0, Vi/{j, i + (51) 

Prom ([55]) we have that Xj(t^) =0, Vi>£+1 and hence using ([^T|) we conclude that = 
0, > ^ + 1, Vt G Xk+i, but in view of ()35p and (jlip in Assumption [TJ3, this implies that 
hi{t) = Oi > 0, y i > i + 1, which contradicts ([32|) and therefore 

n,-^ Vj>£+1. (52) 

Therefore, (001) follows from combining (09]), dSOD and ([52]) with ([371) . 

□□□ 

Consider the interval Tq and suppose there exists uj (z Uq , j > 0. Then in particular vertex 
Cj is optimal Vt € Tq, which implies that Xi{t) = 0, Vi 7^ j, i ^ j + 1. But since x(0) = it 
follows that x{t) = 0, Vt € Tq, which from (jlip and ()35p . implies that /ij(t) = > 0, Vi > 0, 
which contradicts (j32p and therefore we conclude that 

C/o* = W}. (53) 

Now consider interval Ti and suppose uq G C/f. Then in particular vertex cq is optimal 
Vt G Ti, which implies that [/* = C/g, contradicting our hypothesis that U* / Vi = 

0, 1 . . . , g. Furthermore, suppose there exists Uj G f^i , i > 1, then in particular vertex ej is 
optimal Vt G Ti, which implies that Xi{t) = 0, Vi 2^ i ^ j + 1. From ()53p we have that 
3^i(io) = 0, Vz > 1 and hence, we conclude Xj(t) = 0, Vi > 1, Vt G Ti. From (fTTj) and ([35]) . this 
implies that /ii(t) = > 0, Vi > 1, which contradicts (I32p and hence uj ^ f/;^, Vj > 1 and 

C/r = {^i}. (54) 

Eqs. (f53]) and (|54l) imply that 3;j(ti) = 0, Vi > 1 and therefore, we can inductively use Fact [U 
leading to the desired result ([33]) . Consider interval T„,, so that from ([33]) it holds that C/* = {un}- 
Then from ([H]) it follows that hn{t) = min {/io(t), hi{t), Kit)} ,\/t£Tn, but from ([46l) - ([4Hl) 
we have that it does not exist /ij(t), i 7^ n such that hi(t) < hn{t) for t > t„_i, thus implying 
that Xn{t) < 0, Vt > tri-i- This in turn means that lim^^oo Xn{t) = and therefore the terminal 
condition (|2ip fails and — > 00, which leads us to the conclusion that Un{t) is never active and 
pip follows. 

□□□ 
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